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The  long-term  efficacy  of  making  resistance  testing  routinely  available  to  clinicians  has  not  been  established. 
We  conducted  a  clinical  trial  at  6  US  military  hospitals  in  which  volunteers  infected  with  human  immuno¬ 
deficiency  virus  type-1  were  randomized  to  have  routine  access  to  phenotype  resistance  testing  (PT  arm), 
access  to  genotype  resistance  testing  (GT  arm),  or  no  access  to  either  test  (VB  arm).  The  primary  outcome 
measure  was  time  to  persistent  treatment  failure  despite  change(s)  in  antiretroviral  therapy  (ART)  regimen. 
Overall,  routine  access  to  resistance  testing  did  not  significantly  increase  the  time  to  end  point.  Time  to  end 
point  was  significantly  prolonged  in  the  PT  arm  for  subjects  with  a  history  of  treatment  with  3=4  different 
ART  regimens  or  a  history  of  treatment  with  nonnucleoside  reverse-transcriptase  inhibitors  before  the  study, 
compared  with  that  in  the  VB  arm.  These  results  suggest  that  routine  access  to  resistance  testing  can  improve 
long-term  virologic  outcomes  in  HIV-infected  patients  who  are  treatment  experienced  but  may  not  impact 
outcome  in  patients  who  are  naive  to  or  have  had  limited  experience  with  ART. 


Resistance  to  antiretroviral  therapy  (ART)  is  an  im¬ 
portant  cause  of  treatment  failure  in  patients  infected 
with  HIV-1  [1],  Resistance  to  ART  has  also  been  noted 
in  HIV  isolates  recovered  from  treatment-naive,  newly 
infected  patients  [2-4],  with  a  prevalence  that  appears 
to  be  increasing  [5]. 


There  are  2  types  of  assays  available  for  measurement 
of  ART  resistance.  Genotype  tests  identify  polymor¬ 
phisms  in  the  HIV  genome  associated  with  resistance, 
and  phenotype  tests  measure  ART  susceptibility  in  vi¬ 
tro.  Genetic  polymorphisms  associated  with  drug  re¬ 
sistance  have  been  retrospectively  shown  to  be  associ¬ 
ated  with  treatment  failure,  development  of  AIDS,  and 
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death  [6-10].  Several  prospective  studies  have  shown  short¬ 
term  improvement  in  virus  load  (VL)  suppression  in  patients 
when  genotype  testing  [11,  12],  phenotype  testing  [13],  or  ge- 
notyping  with  the  advice  of  expert  virologists  [14]  was  used  to 
guide  therapy.  Other  recent  studies  showed  either  transient  [15] 
or  no  benefit  [16]  associated  with  the  use  of  resistance  assays. 

An  International  AIDS  Society-USA  panel  has  recommended 
that  resistance  testing  be  used  to  help  guide  ART  selection  at 
the  time  of  treatment  failure  and  that  they  be  considered  for 
treatment-naive  patients  at  the  time  of  therapy  initiation  [17]. 
The  major  impediment  to  the  routine  use  of  either  genotype 
or  phenotype  assays  is  cost  ($400-$  1000  per  assay),  which  is 
outside  of  the  range  of  affordability  for  many  HIV-infected 
patients.  A  more  fundamental  concern  is  the  lack  of  infor¬ 
mation  about  the  long-term  efficacy  of  the  routine  use  of  re¬ 
sistance  tests  in  the  management  of  HIV- 1  infection. 

We  conducted  a  prospective,  randomized,  multicenter  study 
comparing  the  therapeutic  efficacy  of  routine  access  to  and  use 
of  genotype  and  phenotype  resistance  testing  and  results  with 
those  for  clinical  management  without  resistance  testing  in  a 
cohort  of  HIV-l-infected  beneficiaries  of  US  Department  of 
Defense  (DoD)  health  care.  The  study’s  goal  was  to  determine 
the  long-term  efficacy  of  routinely  available  resistance  testing, 
as  defined  by  an  increase  in  the  time  to  refractory  treatment 
failure.  Emulation  of  actual  clinical  practice  patterns  was  re¬ 
flected  in  the  study  design.  Results  from  commercially  available 
resistance  tests  were  provided  to  treating  clinicians  without 
expert  recommendations  regarding  test  interpretation. 

METHODS 

Participants 

HIV-l-infected  beneficiaries  of  DoD  health  care  were  eligible 
for  the  Centers  for  Education  and  Research  on  Therapeutics 
(CERT)  study  if  they  were  3=18  years  of  age,  were  receiving  a 
stable  ART  regimen  containing  32  drugs  for  at  least  8  weeks 
before  randomization,  were  able  to  provide  informed  consent, 
and  were  willing  to  attend  regular  study  visits.  Participating 
centers  were  the  following  DoD  tertiary  care  facilities:  Walter 
Reed  Army  Medical  Center  (Washington,  DC),  National  Naval 
Medical  Center  (Bethesda,  MD),  Naval  Medical  Center  (Ports¬ 
mouth,  VA),  Wilford  Hall  Air  Force  Medical  Center  and  Brook 
Army  Medical  Center  (San  Antonio,  TX),  and  Naval  Medical 
Center  (San  Diego,  CA).  Volunteers  were  recruited  by  direct 
inquiry  from  treating  clinicians  at  these  centers. 

Study  Regimens  and  Randomization 

The  protocols  and  consent  forms  were  approved  by  the  insti¬ 
tutional  review  boards  of  each  participating  institution  and  by 
the  Tri-Service  Human  Subjects  Research  Review  Board.  Eli¬ 
gible  volunteers  were  randomly  assigned  to  1  of  3  study  arms: 


those  with  routine  access  to  phenotype  resistance  testing  (PT 
arm)  or  genotype  resistance  testing  (GT  arm)  and  those  without 
such  access  (VB  arm).  A  total  of  611  patients  were  screened 
from  October  1998  through  October  2000,  of  whom  450  were 
randomized.  Active  study  follow-up  continued  until  October 
2001.  The  randomization  procedure  was  developed  and  per¬ 
formed  centrally  at  the  US  Military  Research  Program  Data 
Coordinating  and  Analysis  Center  (DCAC).  Volunteers  were 
randomized  using  a  permuted  block  algorithm  stratified  by 
study  site  and  Centers  for  Disease  Control  and  Prevention 
(CDC)  HIV  disease  stage. 

Study  algorithm.  The  study  algorithm  was  designed  so 
that  end  points  would  signify  refractory  treatment  failure.  To 
reach  an  end  point,  a  participant  would  have  to  have  treatment 
failure  that  was  persistent,  despite  changes  in  therapy  that  were 
guided  in  the  GT  and  PT  study  arms  by  results  of  resistance 
tests. 

Routine  study  visits.  Participants  were  evaluated  at  routine 
study  visits  every  3-4  months.  At  each  visit,  plasma  VL  was 
measured  using  the  Roche  Amplicor  ultrasensitive  assay  (Roche 
Molecular  Systems),  which  has  a  lower  detection  limit  of  50 
copies/mL. 

Treatment  failure  criteria.  Treatment  failure  was  defined 
as  a  VL  of  >3.0  log10  copies/mL  concomitant  with  3=1  of  the 
following  conditions:  <1.0  log10  reduction  in  VL  4  weeks  after 
starting  a  therapy  regimen,  failure  to  suppress  VL  to  <200 
copies/mL  6  weeks  after  starting  therapy,  detection  of  a  plasma 
VL  of  >3.0  log10  copies/mL  after  initial  suppression  to  <200 
copies/mL,  or  an  increase  of  >0.5  log10  copies/mL  (to  >3.0  log10 
copies/mL)  from  the  nadir  VL  that  could  not  be  directly  at¬ 
tributed  to  vaccination  or  intercurrent  illness.  The  lower  limit 
of  3.0  log10  copies/mL  was  chosen  to  minimize  the  effects  of 
VL  “blips”  on  the  conduct  of  the  study  and  to  reflect  the 
performance  limits  of  the  resistance  assays.  Failure  criteria  were 
not  mutually  exclusive. 

Confirmation  of  treatment  failures.  All  treatment  failures 
were  confirmed  with  a  second  VL  measurement  during  a  con¬ 
firmation  visit  10-14  days  later. 

Changing  failing  therapy  regimens.  Upon  confirmation 
of  treatment  failure,  the  treating  clinician  was  offered  the  op¬ 
portunity  to  make  changes  in  the  participant’s  drug  regimen. 
No  changes  were  mandated  by  the  protocol. 

Reevaluation  of  therapy  changes  and  study  end  points. 
Four  to  6  weeks  after  a  confirmed  treatment  failure,  the  par¬ 
ticipant  returned  for  reevaluation  to  determine  whether  failure 
persisted,  despite  therapy  changes.  If  failure  was  found  to  per¬ 
sist,  a  study  end  point  was  attained.  If  the  failure  had  resolved, 
no  end  point  was  attained,  and  the  participant  was  asked  to 
return  in  3-4  months  for  another  routine  visit.  To  reach  an 
end  point,  2  consecutive  confirmed  treatment  failures — deter- 
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mined  during  a  routine  visit  and  a  subsequent  reevaluation 
visit — were  required. 

For  participants  in  the  PT  arm,  an  Antivirogram  phenotype 
assay  (Virco)  was  performed  during  each  routine  visit  if  the 
VL  was  >3.0  log10  copies/mL.  For  participants  in  the  GT  arm, 
a  commercially  available  genotype  assay  was  performed  during 
each  routine  visit  if  the  VL  was  >3.0  log10  copies/mL.  From 
study  initiation  until  June  2000,  the  Vircogen  assay  (Virco)  was 
used  in  the  GT  arm.  After  this  date,  the  Virtual  Phenotype 
interpretation  method  (Virco)  was  added.  Details  about  the 
assays  have  been  published  elsewhere  [18-20], 

Statistical  Analysis 

The  primary  analysis  in  this  study  was  the  pair-wise  comparison 
of  differences  in  times  to  end  point  between  study  arms  (VB 
vs.  GT  and  VB  vs.  PT).  Secondary  analyses  compared  times  to 
end  point  between  study  arms,  grouping  participants  according 
to  previous  ART  exposure.  The  primary  efficacy  variable  was 
time  to  end  point,  which  was  defined  as  time  from  study  ran¬ 
domization  through  time  to  protocol-defined  study  end  point, 
study  discontinuation,  or  loss  to  follow-up.  Right-censoring  of 
time  to  event  was  performed  for  participants  who  were  still 
active  in  the  study  and  for  those  who  had  not  reached  a  pro¬ 
tocol-defined  end  point  at  the  time  of  data  analyses.  All  analyses 
were  performed  according  to  the  intent-to-treat  (ITT)  prin¬ 
ciple:  end  points  for  all  participants  who  were  terminated  from 
the  study  because  of  consent  withdrawal,  loss  to  follow-up, 
relocation  away  from  the  study  site,  medical  reasons,  or  a  pro¬ 
tocol  violation  were  specified  as  the  date  on  which  study  par¬ 
ticipation  ended.  The  ITT  population  comprised  all  random¬ 
ized  participants  who  underwent  follow-up  assessment. 

Baseline  variables  were  compared  among  study  arms  using 
Student  t  test  and  x2  analysis  for  continuous  and  categorical 
variables,  respectively.  Nonparametric  product-limit  estimation 
(Kaplan-Meier)  was  used  to  estimate  the  time  to  end  point 
survival  function  in  each  study  arm.  The  Wilcoxon  log  rank 
test  was  used  to  compare  time  to  end  point  between  study 
arms. 

The  Hochberg  method  (a  modified  Bonferroni  procedure) 
was  used  to  retain  an  overall  2-sided  type  I  error  rate  of  .05 
during  multiple  comparisons  of  the  primary  and  secondary  end 
points,  as  described  elsewhere  [21].  This  method  rejected  both 
null  hypotheses  if  and  only  if  the  largest  P  value  obtained  was 
^.05  (2-sided).  Otherwise,  the  smallest  P  value  obtained  had 
to  be  ^.025  to  be  considered  statistically  significant  with  respect 
to  the  respective  null  hypothesis. 

Univariate  and  multivariate  Cox  proportional  hazards  re¬ 
gression  models  were  used  to  evaluate  the  effects  of  study  arm, 
age,  sex,  race,  CDC  stage,  exposure  to  nonnucleoside  reverse- 
transcriptase  inhibitors  (NNRTIs),  initial  plasma  HIV  RNA 


load,  and  prestudy  ART  experience.  Statistical  analyses  were 
performed  using  SPLUS  6,  version  2  for  Windows  (Insightful). 

Data  Collection,  Management,  and  Quality  Assurance 

All  data  were  collected  on  standardized  case  report  forms  by 
certified  clinical  research  coordinators,  according  to  standard¬ 
ized  Good  Clinical  Practice  study  procedures.  Study  data  were 
entered  into  a  central  database  maintained  by  DCAC.  Double 
data-entry  techniques,  routine  database  checks,  and  frequent 
site  visits  ensured  data  quality. 

RESULTS 

Baseline  clinical  and  demographic  characteristics.  Baseline 
demographic  characteristics,  HIV  disease  characteristics,  and 
treatment  histories  of  study  volunteers  are  summarized  in  table 
1.  There  were  no  significant  interarm  differences  in  any  of  the 
baseline  characteristics  except  for  age,  which  was  slightly  higher 
in  the  GT  arm 

ART  history  at  study  entry.  All  volunteers  were  ART  ex¬ 
perienced,  with  a  mean  history  of  exposure  to  3.9  drugs  (range, 
3. 6-4.2  days).  Volunteers  had  a  mean  history  of  exposure  to 
2.4  nucleoside  reverse-transcriptase  inhibitors  (NRTIs),  0.3 
NNRTIs,  and  1.2  protease  inhibitors  (Pis);  351  (78%)  were 
NNRTI  naive.  One  hundred  forty-three  (31.8%)  volunteers  had 
a  history  of  treatment  with  >2  Pis  at  the  time  of  enrollment. 
The  most  common  combinations  of  drugs  were  stavudine- 
lamivudine-nelfinavir  (n  =  52)  and  zidovudine-lamivudine- 
nelfinavir  in  =  43).  Pre-enrollment  ART  history,  by  study  arm 
and  drug  type,  is  shown  in  table  1. 

Study  discontinuations.  A  total  of  128  volunteers  discon¬ 
tinued  participation  in  the  study  for  reasons  other  than  having 
reached  a  study  end  point  (figure  1).  There  were  no  significant 
pair-wise  differences  in  the  number  of  non-end  point  discon¬ 
tinuations,  time  to  non-end  point  discontinuation,  or  in  the 
VL  at  time  of  discontinuation. 

Primary  outcome:  time  to  refractory  treatment  failure. 
Median  and  mean  times,  respectively,  to  end  point  or  censoring 
were  621  and  585  days  for  the  VB  arm,  668  and  799  days  for 
the  GT  arm,  and  683  and  736  days  for  the  PT  arm.  There  were 
no  significant  differences  in  mean  time  to  end  point  among 
study  arms  (figure  2). 

A  secondary  analysis  was  performed  to  compare  time  to 
event  between  study  arms  for  volunteers  who  had  an  ART 
history  of  <4  drugs.  This  analysis  demonstrated  that  there  were 
no  significant  pair-wise  differences  in  time  to  end  point  between 
study  arms  ( P  =  .36  for  VB  vs.  GT  arms,  and  P  =  .07  for  VB 
vs.  PT  arms).  For  volunteers  with  a  history  of  receipt  of  &4 
ART  drugs  before  enrollment,  there  was  a  notable  increase  in 
time  to  end  point  in  the  PT  arm  (P  =  .043)  but  not  in  the  GT 
arm  ( P  =  .553),  compared  with  the  VB  arm  (figure  3,  right). 
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Table  1.  Baseline  demographic  and  clinical  characteristics  of  450  participants  in  the 
Clinical  Efficacy  of  Resistance  Testing  Trial  who  had  no  access  to  testing  (VB  arm)  or  who 
had  access  to  genotype  testing  (GT  arm)  phenotype  testing  (PT  arm). 


Characteristic 

GT  arm 
(n  =  151) 

PT  arm 
(n  =  152) 

VB  arm 
(n  =  147) 

Percentage  of  total  enrollment 

33.6 

33.8 

32.7 

Sex 

Female 

18  (11.9) 

23  (15.1) 

16  (10.9) 

Male 

133  (88.1) 

129  (84.9) 

131  (89.1) 

Race3 

African  American 

61  (40.4) 

53  (34.9) 

56  (38.1) 

Asian 

0  (0) 

3  (2.0) 

6  (4.1) 

White 

72  (47.7) 

83  (54.6) 

73  (49.7) 

Hispanic 

18  (11.9) 

12  (7.9) 

10  (6.8) 

Other/not  specified 

0  (0) 

1  (0.7) 

2  (1.4) 

Age,b  mean  years  ±  SD 

39.8  ±  8.8 

37.8  ±  7.9 

37.5  ±  9.0 

CDC  HIV  stage 

A 

103  (68.2) 

104  (68.4) 

93  (63.2) 

B 

21  (13.9) 

26  (17.1) 

22  (15.0) 

C 

27  (17.9) 

22  (14.5) 

32  (21.8) 

CD4  cell  count,  mean  cells/mL  ±  SD 

478.0  ±  265.3 

498.8  ±  279.2 

436.1  ±  241.7 

Virus  load,  mean  log10  copies/mL  ±  SD 

2.7  ±  1.1 

2.7  ±  1.1 

2.8  ±  1.2 

Mean  number  of  ARVs  received 

3.42 

3.49 

3.23 

Protease  inhibitors,  no.  received 

=s2 

105  (69.5) 

98  (64.5) 

104  (70.7) 

>2 

46  (30.5) 

54  (35.5) 

43  (29.3) 

ARV  history,  mean  no.  received 

Protease  inhibitors 

1.14 

1.40 

1.38 

NNRTIs 

0.23 

0.28 

0.27 

NRTIs 

2.44 

2.55 

2.18 

Total 

3.81 

4.23 

3.63 

NNRTI  experienced 

31 

35 

33 

NOTE.  Data  are  no.  (%)  of  patients  at  enrollment,  unless  otherwise  indicated.  Categorical  variables  were 
compared  using  x2  analysis,  and  continuous  variable  were  compared  using  Student's  f  test.  ARV,  antiretroviral; 
CDC,  Centers  for  Disease  Control  and  Prevention;  NNRTI,  nonnucleoside  reverse-transcriptase  inhibitor;  NRTI, 
nucleoside  reverse-transcriptase  inhibitor. 
a  Self-reported. 
b  P<  .05 

There  were  no  significant  pair-wise  differences  in  time  to  end 
point  between  study  arms  for  volunteers  who  were  NNRTI 
naive  at  enrollment  (P  =  .90  for  VB  vs.  GT  arms,  and  P  = 

.83  for  VB  vs.  PT  arms).  Compared  with  the  VB  arm,  there 
was  a  significant  increase  in  time  to  end  point  in  the  PT  arm 
( P  =  .01)  but  not  the  GT  arm  (P  =  .10)  for  volunteers  who 
were  NNRTI  experienced  at  enrollment  (figure  3,  left). 

A  univariate  Cox  regression  analysis  (table  2)  demonstrated 
that,  in  the  subset  of  NNRTI-experienced  subjects,  the  risk  of 
treatment  failure  was  1.82  times  greater  in  the  VB  arm  than  in 
the  GT  arm  (P  =  .044)  and  2.7  times  greater  in  the  VB  arm 
than  in  the  PT  arm  (P  =  .002).  In  the  subset  of  subjects  with 


a  treatment  history  of  & 4  ART  drugs,  risk  of  treatment  failure 
in  the  VB  arm  was  1.75  and  1.69  times  greater  than  the  risk 
in  the  GT  (P  =  .010)  and  PT  (P  =  .010)  arms,  respectively. 

Treatment  changes  during  study.  The  mean  numbers  of 
ARTs  received  during  the  study  were  4.12,  4.68,  and  4.72  in 
the  VB,  GT,  and  PT  arms,  respectively.  There  were  no  significant 
pair-wise  differences  in  the  numbers  of  NRTIs,  NNRTIs,  or  Pis 
received  during  study  participation. 

Resistance  tests  performed  during  the  study.  A  total  of 
75  subjects  in  the  GT  arm  and  74  subjects  in  the  PT  arm  never 
had  a  VL  of  >3.0  log10  copies/mL  during  the  study  and,  con¬ 
sequently,  had  no  resistance  tests  performed.  Thirty-six  subjects 
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Figure  1.  Flow  chart  of  the  Clinical  Efficacy  of  Resistance  Testing  study  involving  the  following  3  groups:  patients  with  routine  access  to  phenotype 
resistance  testing  (PT  arm)  or  genotype  resistance  testing  (GT  arm)  and  patients  without  such  access  (VB  arm). 


in  the  GT  arm  and  26  subjects  in  the  PT  arm  underwent  3=1 
resistance  test  but  never  reached  a  study  end  point.  The  mean 
turn-around  times  for  the  resistance  assays  were  5  and  21  work¬ 
ing  days  for  the  genotype  and  phenotype  assays,  respectively. 

DISCUSSION 

The  purpose  of  the  CERT  study  was  to  determine  the  long¬ 
term  efficacy  of  the  routine  access  to  resistance  testing  in  a 
realistic  clinical  practice  setting  through  the  use  of  commercially 
available  resistance  tests  and  a  study  algorithm  modeled  after 
standard  of  care.  This  study  design  differs  from  those  of  several 
previous  studies,  which  addressed  the  impact  of  resistance  test¬ 
ing  on  relatively  short-term  virologic  end  points  in  highly  struc¬ 
tured  clinical  settings.  Because  of  the  unique  design  of  our 
study,  which  was  intended  to  assess  long-term  impact  of  access 
to  resistance  testing,  direct  outcomes  comparisons  with  other 
studies  is  difficult. 

Several  previously  published  prospective  studies  have  shown 
a  benefit  to  be  associated  with  resistance  testing  [11-13].  Two 
studies  have  suggested  that  the  benefit  of  resistance  testing  is 
increased  when  expert  interpretation  of  the  resistance  test  re¬ 
sults  is  used  to  guide  therapy  changes  [12,  14],  although  a  third 
study,  which  included  a  cohort  of  predominately  heavily  pre¬ 


treated  patients,  failed  to  show  even  relatively  short-term  vi¬ 
rologic  improvement  with  the  use  of  either  phenotype  or  ge¬ 
notype  resistance  tests  in  combination  with  expert  advice  [16]. 

The  CERT  study  did  not  show  that  an  overall  improvement 
in  the  time  to  refractory  treatment  failure  was  associated  with 
routine  access  to  either  genotype  or  phenotype  resistance  test¬ 
ing,  when  used  in  a  cohort  of  patients  with  a  large  number  of 
enrollees  with  limited  previous  ART  exposure.  Causes  of  long¬ 
term  treatment  failure  other  than  resistance,  such  as  incomplete 
adherence  to  therapy  and  pharmacokinetic  factors,  compromise 
the  power  to  accurately  assess  the  impact  of  resistance  testing, 
even  in  large  studies  such  as  CERT.  In  addition,  the  CERT 
cohort  had  many  subjects  who  never  experienced  treatment 
failure  and,  thus,  never  required  resistance  testing,  which  also 
limits  the  study’s  power. 

Nonetheless,  in  the  subset  of  CERT  volunteers  with  relatively 
more  ART  experience,  therapy  changes  guided  by  phenotype 
resistance  testing  prolonged  the  time  to  refractory  treatment 
failure.  This  subgroup  likely  includes  a  higher  prevalence  of 
drug  resistance,  which  would  have  the  effect  of  potentially  in¬ 
creasing  the  benefits  associated  with  testing. 

No  benefit  from  the  routine  access  to  genotype  testing  was 
observed  in  the  primary  analysis  of  this  study,  although  uni¬ 
variate  Cox  regression  analysis  showed  modest  but  statistically 
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Figure  2.  Estimated  time  to  end  point  curves  in  the  intent-to-treat  analysis  involving  the  following  3  groups:  patients  with  routine  access  to 
phenotype  resistance  testing  (PT  arm)  or  genotype  resistance  testing  (GT  arm)  and  patients  without  such  access  (VB  arm).  The  estimated  percentage 
of  subjects  not  reaching  the  end  point  is  represented  on  the  y  axis,  and  the  time  to  end  point  is  represented  on  the  x  axis.  Two-arm  survival  comparisons 
using  log-rank  and  x2  tests  resulted  in  P  values  of  .39  (VB  vs.  GT  arms)  and  .29  (VB  vs.  PT  arms). 


significant  differences  in  hazard  ratios  between  the  VB  and  GT 
arms  for  volunteers  with  a  history  of  3=4  ARTs  or  NNRTI 
experience  before  enrollment.  The  relative  lack  of  benefit  from 
readily  available  genotype  testing  results  in  the  CERT  study  is 


NNRTI  experienced 


Time  after  study  entry,  days 


at  odds  with  the  results  of  some  of  the  other  previously  pub¬ 
lished  studies  mentioned  above,  with  the  exception  of  the  NAR- 
VAL  study  [28].  Most  of  the  other  studies  have  assessed  short¬ 
term  changes  in  viral  burden,  in  contrast  to  the  long-term 


History  of  >  4  ARVs 


Figure  3.  Estimated  time  to  end  point  curves  for  participants  who  had  a  history  of  treatment  with  nonnucleoside  reverse-transcriptase  inhibitors 
(NNRTIs)  (left)  or  ^4  antiretroviral  (ART)  agents  before  study  enrollment  (right;  the  time  to  end  point  in  NNRTI-experienced  subjects  is  indicated). 
Log-rank  pairwise  comparisons  for  the  NNRTI-experienced  subgroup  yielded  P  values  of  .1  (patients  without  access  to  testing  [VB]  vs.  patients  with 
access  to  genotype  testing  [GT])  and  .01  (VB  vs.  patients  with  access  to  phenotype  testing  [PT]).  For  the  ART-experienced  subgroup,  pairwise  comparisons 
using  the  log-rank  test  resulted  in  P  values  of  .55  (VB  vs.  GT  arms)  and  .04  (VB  vs.  PT  arms). 
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Table  2.  Univariate  Cox  proportional  hazard  ratios  representing  the  risk  of  reaching  a  study 
end  point  for  subjects  who  had  no  access  to  testing  (VB  arm),  compared  with  those  who  had 
access  to  genotype  testing  (GT  arm)  or  phenotype  testing  (PT  arm). 


VB  vs.  GT  arms 

VB  vs.  PT  arms 

Variable 

Hazard  ratio  (95%  Cl) 

pa 

Hazard  ratio  (95%  Cl) 

Pa 

NNRTI  history  before  study  entry 

Naive 

0.98  (0.68-0.70) 

NS 

0.97  (0.67-1.39) 

NS 

Experienced 

1.82  (1.02-3.33) 

.04 

2.7  (1.45-5.00) 

<.01 

ARV  history,  no.  received 

<4 

0.75  (0.48-1.19) 

NS 

0.93  (0.58-1.52) 

NS 

s4 

1.75  (1.15-2.7) 

.01 

1.69  (1.12-2.56) 

.01 

NOTE.  A  hazard  ratio  >1  indicates  an  increased  risk  of  reaching  a  study  end  point  for  subjects  in  the  VB 
arm.  ARV,  antiretroviral;  NNRTI,  nonnucleoside  reverse-transcriptase  inhibitor;  NS,  not  significant. 
a  By  the  Wald  Test.  Ps  .05  was  considered  to  be  statistically  significant. 


efficacy  end  point  of  the  CERT  study.  In  addition,  all  subjects 
in  the  resistance-testing  arms  of  these  studies  underwent  test¬ 
ing,  in  contrast  to  the  patients  in  the  CERT  study. 

Another  possible  reason  for  the  inability  to  show  durable 
benefits  associated  with  genotype-guided  therapy  is  that  the 
interpretation  of  mutation  patterns  is  inherently  complex.  In 
the  absence  of  selective  therapy  pressure,  virus  variants  with 
resistance-conferring  mutations  may  rapidly  be  outcompeted 
by  wild-type  strains,  causing  them  to  be  undetectable  by  current 
assays  [22].  Consequently,  a  clinician  may  falsely  conclude  that 
a  virus  is  susceptible  to  a  given  drug.  However,  when  that  drug 
is  reintroduced,  the  virus  variants  with  resistance-conferring 
mutations  will  rapidly  reemerge  and  lead  to  therapy  failure. 
The  interactions  between  mutations  to  confer  cross-resistance 
or  to  suppress  the  effect  of  other  mutations  have  been  exten¬ 
sively  reviewed  elsewhere  [17].  Several  different  strategies  for 
the  interpretation  of  viral  mutation  patterns  have  been  devel¬ 
oped  and  compared  [23-26].  In  the  CERT  study,  a  commer¬ 
cially  available,  algorithm-based  strategy  was  initially  used  for 
the  interpretation  of  genotypes.  An  interpretation  strategy  based 
on  a  relational  database  of  genotypes  and  phenotypes  was  em¬ 
ployed  when  it  became  available  in  June  2000.  It  is  difficult  to 
assess  the  impact  of  these  different  methods  on  the  overall 
outcome  of  the  study.  Furthermore,  the  ability  to  compare 
different  studies  that  assessed  the  impact  of  genotype-based 
management  is  impaired  by  the  variety  of  interpretation  meth¬ 
ods  employed.  There  are  retrospective  data  to  suggest  that  use 
of  the  relational  database  strategy  is  a  better  predictor  of  clinical 
outcome  than  are  algorithm-based  methods  [27],  but  this  ap¬ 
proach  has  not  been  assessed  prospectively.  Potential  advan¬ 
tages  of  genotype  testing  over  phenotype  testing  include  more 
rapid  turn-around  time,  decreased  cost,  and  the  ability  to  per¬ 
form  the  tests  in  many  laboratories,  rather  than  a  few  highly 
specialized  central  facilities. 

The  results  of  the  NARVAL  study  indicated  that  clinicians 


might  prescribe  fewer  drugs  at  the  time  of  treatment  failure 
when  resistance  results  are  available.  Indeed,  in  a  recent  analysis, 
the  NARVAL  group  suggested  that,  for  patients  with  extensive 
prior  ART  exposure  who  did  not  respond  to  HAART,  resistance 
testing  was  cost-effective  when  the  sparing  of  future  drug  costs 
was  considered  [28].  In  contrast,  the  CERT  study  found  no 
differences  in  the  number  of  ARTs  prescribed  to  volunteers  in 
any  of  the  3  arms  during  the  course  of  the  study. 

Cost  is  a  central  issue  in  the  debate  on  the  use  of  resistance 
tests.  The  cost-effectiveness  of  resistance  testing  has  been  dem¬ 
onstrated  in  a  retrospective  study  [29].  Nevertheless,  the  off¬ 
set  of  cost  of  testing  compared  with  the  reduction  in  drug  costs 
did  not  reach  statistical  significance  in  an  economic  analysis  in 
the  VIRADAPT  study  [30].  The  results  from  the  CERT  study 
suggest  that  use  of  resistance  testing  could  be  limited  to  patients 
who  have  at  least  some  history  of  previous  ART  exposure,  which 
may  potentially  decrease  the  overall  cost  burden  without  loss 
of  clinical  effect. 

In  conclusion,  the  CERT  study  shows  that  a  long-term  ben¬ 
efit  of  the  availability  of  resistance  testing  results  for  patients 
with  a  history  of  NNRTI  therapy  or  exposure  to  5*4  ARTs  but 
not  for  those  with  a  less  complex  treatment  history.  Because 
of  the  cost  of  resistance  assays,  additional  analysis  of  the  eco¬ 
nomic  impact  of  their  widespread  use  is  warranted. 
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